Gaze driven interaction for a vehicle

ABSTRACT

According to the invention, a method for modifying operation of at least one system of a vehicle based at least in part on a gaze direction of a driver is disclosed. The method may include receiving gaze data indicative of the gaze direction of a driver of a vehicle. The method may also include modifying operation of at least one system of the vehicle based at least in part on the gaze data.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of Non-Provisional U.S. patentapplication Ser. No. 14/605,677 filed Jan. 26, 2015, entitled “GAZEDRIVEN INTERACTION FOR A VEHICLE,” which claims priority to ProvisionalU.S. Patent Application No. 61/931,364 filed Jan. 24, 2014, entitled“GAZE DRIVEN INTERACTION FOR A VEHICLE,” entire disclosure of which ishereby incorporated by reference, for all purposes, as if fully setforth herein.

BACKGROUND OF THE INVENTION

Embodiments of the present invention generally relate to systems andmethods for gaze driven interaction, and in particular, to systems andmethods for gaze interaction for automobiles and other mobile vehicles.

Interactions with personal computers and the like have developedsubstantially, from the traditional computer mouse and keyboard to newmodalities such as touch, gesture, and gaze driven inputs.

Concurrently to this development, automobiles and other mobile vehicleshave increasingly contained more technology, in the form of safetysystems, entertainment systems, and the like.

It has been previously proposed to use eye tracking and the like tomonitor driver behavior for safety reasons. For example, see U.S. Pat.No. 8,314,707 assigned to Tobii Technology AB whereby an eye tracking ormonitoring device is used to determine a drowsiness level of a vehicledriver, based on closing of the driver's eyelids. U.S. Pat. No.8,314,707 is hereby incorporated by reference, for all purposes, as iffully set forth herein.

A problem exists with current technology in automobiles and other mobilevehicles whereby a user must physically interact with the technology,thereby distracting them from devoting available physical and mentalresources from controlling the vehicle. For example, in an automobilecomprising a touch enabled central control system, a user mustphysically touch the display in order to control the unit, possibly evendiverting their attention from the road to do so. Controls may also beenacted by physical buttons or the like on the central control system,or on the steering wheel of the automobile.

Typically, such systems requiring interaction from the user are placedon the central console of an automobile or mobile vehicle. This requiresthe user to look away from the road or environment surrounding thevehicle for intermittent and/or prolonged periods in order to makeadjustments or give commands to the system.

One goal of embodiments of the present invention is to provide systemsand methods which minimize and/or alleviate the need of a user to devotemental resources to, and/or physically interact with, technology basedsystems in a moving vehicle.

It is a further goal of embodiments of the present invention to providesystems and methods that allow a user to control a control system of avehicle through gaze interaction, whereby after gaze interaction theuser may continue to control the control system with minimal requirementto provide further gaze interaction, and/or further gaze at the controlsystem. It is a further goal of embodiments of the present invention toprovide systems and methods that allow a user to interact with a controlsystem through gazing at items and/or locations within a vehicle.

This and other goals and advantages of embodiments of the presentinvention will be made apparent from the description, figures, andclaims provided herein.

BRIEF DESCRIPTION OF THE INVENTION

In one embodiment, a method for modifying operation of at least onesystem of a vehicle based at least in part on a gaze direction of adriver is provided. The method may include receiving gaze dataindicative of the gaze direction of a driver of a vehicle. The methodmay also include modifying operation of at least one system of thevehicle based at least in part on the gaze data.

In another embodiment, a non-transitory machine readable medium havinginstructions stored thereon for modifying operation of at least onesystem of a vehicle based at least in part on a gaze direction of adriver is provided. The instructions may be executable by at least oneprocessor for at least receiving gaze data indicative of the gazedirection of a driver of a vehicle. The instructions may also beexecutable for modifying operation of at least one system of the vehiclebased at least in part on the gaze data.

In another embodiment, a system for modifying operation of at least onesystem of a vehicle based at least in part on a gaze direction of adriver is provided. The system may include an eye tracking device and aprocessor. The eye tracking device may be for receiving gaze dataindicative of the gaze direction of a driver of a vehicle. The processormay be for modifying operation of at least one system of the vehiclebased at least in part on the gaze data.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is described in conjunction with the appendedfigures:

FIG. 1 shows a vehicle cabin comprising an eye tracking device suitablefor use in embodiments of the present invention;

FIG. 2 shows a control system display which may be interacted withaccording to embodiments of the present invention;

FIG. 3 shows an item displayable on a control system display which maybe interacted with according to the present invention; and

FIG. 4 shows a block diagram depicting an example computing device forimplementing various embodiments discussed herein.

In the appended figures, similar components and/or features may have thesame numerical reference label. Further, various components of the sametype may be distinguished by following the reference label by a letterthat distinguishes among the similar components and/or features. If onlythe first numerical reference label is used in the specification, thedescription is applicable to any one of the similar components and/orfeatures having the same first numerical reference label irrespective ofthe letter suffix.

DETAILED DESCRIPTION OF THE INVENTION

In some embodiments, a method may be provided for interacting with acontrol system in a moving vehicle. The method may include (1) receivingdata from an eye tracking device; (2) determining, using said data, agaze direction of a user; and (3) based on said gaze direction,providing a command to the control system.

An eye tracking device may be a device capable of detecting anorientation of a user's eye. In some embodiments, this may be achievedby emitting an infrared light towards a user's eye or eyes, and using animage sensor to capture an image containing a reflection or reflectionsof said infrared light. The image may then be analyzed by the eyetracking device, or a computing device connected thereto, to determine agaze direction of a user.

Many commercial eye tracking devices are available from companies suchas Tobii Technology AB. Further information regarding the functioningand characteristics of eye tracking devices may also be found in U.S.Pat. No. 7,572,008 assigned to Tobii Technology AB. U.S. Pat. No.7,572,008 is hereby incorporated by reference, for all purposes, as iffully set forth herein.

In some embodiments, the eye tracking device may be located anywherewithin a moving vehicle, such that it is capable of determining the gazedirection of a person within the moving vehicle, especially, but notlimited to, the driver of the vehicle. In some embodiments, the eyetracking device may also be located such that it can also determine thegaze of passengers in the vehicle. In some embodiments, multiple eyetracking devices may be used to determine the gaze direction of multiplepersons in the vehicle, and/or confirm determinations made by anyparticular eye tracking device.

An example position of an eye tracking device, suitable for use invarious embodiments, may be seen in FIG. 1, which shows an interior of atypical automobile. Locations for placement of infrared illuminators 2and sensors 4 are shown by exaggerated markers to allow for easyidentification and contrast with the image of the automobile interior.These are shown to demonstrate possible positions for these devices,which are then connected directly to a control system having a display10, or to an eye tracking processing device (not shown). Any number ofsensors 2 and illuminators 4 may be utilized to enact eye trackingaccording to embodiments of the present invention. It is intended thatthese may be placed in any configuration and/or location that allows foreye tracking of a user of a vehicle.

The embodiment shown in FIG. 1 allows for eye tracking of a driver ofthe automobile in a normal driving position as well as eye tracking ofthe driver or other user of the automobile using the control system.

In some embodiments, it is possible for the eye tracking device toinclude a processor to determine the gaze direction of a user, or it ispossible for the eye tracking device to be connected to a computingdevice whereby the computing device determines the gaze direction of auser, based on information from the eye tracking device.

Typically, determination of the gaze direction is performed by locatingthe position of reflections of infrared light in an image captured by aneye tracking device. Based on properties of a user's eye and thelocation of reflections upon that eye in a captured image, a user's gazedirection may be determined.

By way of example, eye tracking methods and apparatus are described inU.S. Pat. No. 5,231,674 assigned to LC Technologies, Inc. U.S. Pat. No.5,231,674 is hereby incorporated by reference, for all purposes, as iffully set forth herein. However, any known eye tracking device issuitable for use with embodiments of the present invention, in order todetermine the direction of a user's gaze.

Upon determination of a user's gaze direction, a command may bedetermined for a control system. According to various embodiments, thereare multiple methods of determining the command to provide to a controlsystem. Three example embodiments are discussed below:

First example of a system/method for determining a command to provide toa control system based on a user's gaze

Where a moving vehicle is provided with a physical input device such asa button, switch, movable wheel, touch screen or other physical inputdevice, a determination of a command intended by a user's gaze may bebased upon the function of the physical input device.

For example, a user may activate the input device before, during, and/orafter gazing at a desired interaction point. Upon release of thephysical input device, the point at which the user was/is gazing is usedto determine the command for the control system.

Consider FIG. 2, showing an example of a control system display 12.According to some methods of determining the command intended by auser's gaze, a user may activate a physical input device, gaze at anicon 14 on the control system display 12 and upon a second activation ofthe physical input device, the command determined is based upon whichicon 14 the user is or was gazing at.

Alternatively, the user may maintain activation of the physical inputdevice and release activation whereby the command will be determined bywhich icon 14 the user is gazing at when activation is released.

Alternatively, the user may activate the physical input device after theuser has gazed at the icon 14 he or she intends to interact with.

In some embodiments, visual and/or audio feedback may be provided whichindicates which icon 14 the system/method has determined the user isgazing at. For example, the system/method may cause a visual indicatorto appear on or near icon 14 during or after the user has gazed at theicon, or possibly after the system has determined the command to beperformed. Alternatively, the system may audibly announce an indicationof the perceived command.

Visual feedback may assist the user in understanding the effects of thecommand. In some embodiments, once a command has been determined to beperformed, the user may alter the command using only the physical inputdevice. In other embodiments, a user may alter the command using verbalor gaze-initiated commands.

By way of example, in some embodiments, a moving vehicle may be providedwith an eye tracking device capable of determining the gaze direction ofa driver of the moving vehicle. The eye tracking device may be connectedto a control system having a display located in the center console ofthe moving vehicle.

The moving vehicle may be controlled at least partially by a steeringwheel, in a traditional configuration. The steering wheel may includephysical buttons capable of activation by the driver.

In some embodiments, the user may activate a button on the steeringwheel by pressing the button. While holding the button down, the usergazes at a plurality of icons on the display, when the user selectswhich icon he or she wants to interact with, the user releases thebutton.

The control system may then determine, based on the user's gazedirection, which icon the user wants to interact with. Depending on theembodiment, the icon determined may be the icon gazed at when the buttonis first held down, the icon gazed at during holding of the button, orthe icon gazed at during release of the button. In some embodiments, ifmultiple icons are gazed at, the system may determine which button waspredominately gazed at (i.e., gazed at a majority of the subject time).The icon is then selected and its associated function related to themoving vehicle may then be altered by using the previously discussedbutton, and/or additional buttons on the steering wheel.

For example, the icon may be a temperature adjustment icon, whereby theuser may press “up” or “down” arrow inputs on the steering wheel toadjust the temperature of air emitted by a climate system within themoving vehicle. Visual feedback may be utilized in the form of arrowsabove or below the icon illuminating when the user presses an “up” or“down” arrow. Audible feedback may also be provided.

Visual feedback may be provided in two forms, displayable eitherseparately or concurrently. A first form, as previously described,highlights which item or area on a screen is currently selected forcontrol by the control system. A second form highlights which item orarea on the screen that is currently the subject of a user's gazedirection. In this manner, it is possible to control the control systemafter selection of an item via gaze direction, whilst still allowing theuser to understand where his or her gaze direction is being detected.

For example, a first form of visual feedback for indicating which itemis currently selected for control by the control system could be a“checkmark” graphic or icon which would appear next to an icon; while asecond form of visual feedback for indicating where the system detectsthe user's gaze direction could be a “eyeball” graphic or icon whichwould appear wherever the user's gaze is directed.

Second example of a system/method for determining a command to provideto a control system based on a user's gaze

A user may control the control system by looking directly at a displayeditem on a display. This may be particularly relevant to control multiplesystems with one gaze direction. Consider, by way of example, FIG. 3.FIG. 3 shows an image 60 displayable on a control system display whichallows a user to control items conventionally known as “fade” and“balance” in a vehicle audio system. Adjusting fade and balance allows auser to adjust the position within the vehicle that audio is emittedfrom. Consider that speakers are placed in four corners of the cabin ofthe vehicle, the user may adjust audio levels from each speaker so as toprovide for more or less sound from each speaker, front versus back, andleft versus right.

In some embodiments, a user may gaze at the exact location on image 60representing the desired audio fade/balance output. Upon determinationof the user's gaze direction, the system may provide a visual indicator62 representing the user's gaze direction.

In the example shown in FIG. 3, the user has selected an audioconfiguration whereby audio will be emitted primarily from the frontright hand side of the vehicle. In this way two systems capable of beingcontrolled by the control system have been altered through a gazedirection. In the current example, the two systems are balance and fadecontrols of an audio system. However, this method is also applicable toother controllable systems such as a temperature setting of a vehicle.

Depending upon the systems controlled by the control system, it may benecessary to gaze at multiple locations to set multiple parameters orcontrols of systems. For example, a control system display may show manyclimate settings such as temperature, fan speed, zone temperature,direction of air, origin of air etc. A user may gaze at differentlocations on the display representing commands to modify differentaspects of these settings.

Second example of a system/method for determining a command to provideto a control system based on a user's gaze

In some embodiments, systems and methods disclosed herein may allow forcommands to be provided to a control system whereby the user does notgaze at a display. The eye tracking device may be capable of determininga user's gaze direction relative to any item within a moving vehicle. Assuch, gazing at a particular item may be interpreted by the controlsystem as intent to adjust a function associated with that item.

For example, a user may gaze at a radio if he or she wishes to adjustthe volume of the radio, or at an air grille if he or she wishes toadjust the temperature of air emitted by the vehicles climate system,and/or the particular air grille gazed at.

In this manner, the method of determining the command may compriseanalyzing a user's gaze direction when an input device is activated ordeactivated. Based on the item within the moving vehicle at which theuser is gazing, the control system may execute a command. In these orother embodiments, once a user has utilized a gaze direction to select asystem to control via the control system, the system remainscontrollable by the user until another system is selected. For example,if a user gazes at an item on a display or other item within a vehicleto select a system for control such as temperature, audio, or othersystem, that system is controllable through the control system untilanother selection is made by the user. In this manner, the user mayselect a system such as a stereo and make adjustments through manualcontrols such as buttons, touch screen, rotatable knobs and the like toparameters such as volume, treble, bass, station selection, trackselection etc. Verbal or gaze commands could also be used to performthese functions after selection of the system via the user's gaze.

In some embodiments, audible or haptic feedback may be provided toenhance control of a control system. In this manner, the feedback mayassist in allowing the user to understand when he or she is controllingthe control system. For example, once a user has selected a system forcontrol using their gaze direction they may alter the control viabuttons or the like. These buttons, and/or associated systems, mayprovide haptic or audible feedback, and provide input mechanisms suchthat the user may alter control of the selected system without directingtheir gaze away from other portions of the environment.

Further improvements may be provided in some embodiments. For example, aphysical input device may be provided to enable the control system toaccess the eye tracking device. This may assist in allowing the user tocontrol when he or she intends on using gaze direction to issue commandsto the control system.

Further, the control system display need not be a display in the mannerof a liquid crystal or similar display. Given that the present inventionmay function through determination of a gaze direction towards anyfeature in a vehicle, in some embodiments the control system display maybe illuminated or non-illuminated portions of a dashboard and/or otherportion of the interior or exterior of the vehicle. In theseembodiments, the illumination of the dashboard or any particular portionor more of the instrument panel may be configured to be at one lightinglevel when the user is not looking at it, but at a greater lightinglevel when the user is looking at it. For any particular portion, or theentirety, of such panel, the panel may only be dimmed when the system issure the driver is not observing the panel. This is to ensure the safestcondition (high illumination for readability/viewability) is the defaultcondition. Thus, a receipt of gaze data indicating an affirmative drivergaze on a non-panel location may be necessary prior to dimming of thepanel (or portion thereof).

Further, when a control system display is utilized, a gaze directionneed not be determined to be directly at an icon or other displayed areaon the display. Rather, the system may determine that a gaze directionwithin a threshold distance of a displayed item is sufficient to enact acommand. This allows the system to function when a gaze is not directlylocated on a displayed item due to haste of the user, system error,and/or noise effecting the determination of the gaze direction.

The control system may be in communication with remote devices such astelephones, servers, and/or the internet. It is intended that someembodiments of the present invention provide gaze driven interaction fordata obtained from these devices. For example, the control system mayutilize maps downloaded from the internet for a navigation system of avehicle. The navigation system may be interacted with based on gazedirection as previously described, including searching for locations,setting destinations, and/or requesting directions from the navigationsystem.

In some embodiments, a system may be provided for interacting with avehicle using gaze as per any of the methods previously described. Thesystem may include an eye tracking device connected to a control systemof a vehicle. The control system may be capable of controlling an itemwithin a vehicle such as a climate unit, stereo, telephone, television,safety systems, on board computer, etc. The eye tracking device may beconnected via traditional wiring such as USB or the like, or mayalternatively be wirelessly connected to the control system throughBluetooth or any other suitable wireless connection as would beunderstood by a person skilled in the art.

In some embodiments, the control system may receive a gaze directionfrom the eye tracking device without some other indication of intentfrom a user. This may still allow the control system to performfunctions and control systems without active interaction from the user.For example, the control system may determine that the user has gazed ata message displayed on display such as a service message and thus removethe message from the display.

Metrics for determining, from gaze information, whether a user hasviewed a message or notification on a display may include specific gazedwelling times on the display/message/notification and/or a particulargaze pattern (e.g., scanning a message from left to right, therebyindicating reading of the message is occurring). Additionally, in someembodiments, a non-gaze interaction such as a control button input,voice command/cue, and or hand or body gesture can assist, along withthe gaze information, in determining whether to dismiss amessage/notification. The message can be dismissed, minimized, maximized(e.g., upon dwell). This action could be for a predetermined period(e.g., minimize for 5 minutes). As a further embodiment, the messagecould be linked to a further action, for example display message “Low onfuel,” and upon gaze, new options could appear “Navigate to nearest fuelstation” and “Ignore,” these options could be selected by gaze, spokenword, and/or other input such as button/control input.

As another example, the control system may receive information from theeye tracking device such as a user's gaze pattern or biometric data suchas distance between eyes and iris size, and thus determine the identityof the user and control systems according to potentially predefinedpreferences of the user (otherwise known as user profile selection). Forexample, illumination of items within the vehicle may be altered basedupon a user gazing upon those items. Thus, for one particular user asdetected by the system, a button may be illuminated when the user isgazing at it, or a display may be dimmed if a user is not gazing at it.In another example, the brightness of instrumentation illumination maybe set based on which user profile is selected by the system. Thecontrol system may control these functions upon receiving or determininginformation defining the user's gaze direction.

In some embodiments, a control system may control systems based on aseries or sequence of gaze directions. In this manner, the controlsystem may analyze gaze directions over a period of time. This may beparticularly useful for safety systems capable of being controlled bythe control system. For example, the control system may determine basedon a series of gaze directions that a user is desiring to control thevehicle to switch lanes, exit a highway, stop suddenly, etc. This may bedue to the user gazing at items outside of the environment of thevehicle. Alternatively, the system may determine the user is not gazingat items outside the environment of the vehicle and is gazing at itemsinside the vehicle too frequently or for a prolonged period of time.Based on the gaze direction information, the control system may enactsafety features of a vehicle such as braking systems, steering systems,accelerator limiting systems, and the like, to provide for a saferenvironment.

In some embodiments, gaze information may be used to override warningsystems. For example, while a lane change warning may normally issuefrom a vehicle if inter-lane movement is detected, certain gazeinformation, such as the driver checking rear-view and side mirrorsprior to lane movement may cause such alarms to be overridden (thereforereducing the number of false alarms). Further, the control system mayalso analyze input from sensors such as imaging sensors, thermal imagingsensors, infrared sensors, temperature sensors, and the like. This inputmay be used in combination with gaze direction information by thecontrol system to determine relevant safety systems to control. In somescenarios the control system may control systems without notifying theuser.

In the present disclosure, a gaze direction is used to describe alocation at which a user is gazing or in other words looking, this maybe a point upon a one-dimensional vector, a plane such as a display,and/or a point in three dimensional space.

In the present disclosure, any reference to an eye tracking device orsimilar device is intended to include any device capable of determininga user's gaze direction.

In the present disclosure, any reference to a computing system, controlsystem, or the like, is intended to include a device containingprocessing capabilities for executing instructions.

In the present disclosure, any reference to a vehicle, moving vehicle,automobile, etc. is intended to include a vehicle capable of movingalong a road, a rail, at sea, in air or space, and/or on or in othermediums. Merely by way of example, such vehicles may include personaltransport devices (i.e., bikes, Segways™), scooters, motorcycles, cars,trucks, trains, boats, helicopters, planes, space vehicles, etc.

In the present disclosure, activation of an input device may comprisevoice activation. Voice may be detected by at least one microphoneplaced within the vehicle and connected to the control system. The atleast on microphone may serve more than one purpose, for example it mayalso be utilized as part of a telephone system.

Any detail discussed herein with respect to one embodiment may or maynot be present in all versions of that embodiment. Additionally, anydetail discussed herein with respect to one embodiment may or may not bepresent in all versions of other embodiments discussed herein.

The computing device(s) or systems discussed herein are not limited toany particular hardware architecture or configuration. A computingdevice can include any suitable arrangement of components that provide aresult conditioned on one or more inputs. Suitable computing devicesinclude multipurpose microprocessor-based computer systems accessingstored software that programs or configures the computing system from ageneral purpose computing apparatus to a specialized computing apparatusimplementing one or more embodiments of the present subject matter.

By way of example and not limitation, FIG. 4 is a block diagramdepicting an example computing device 402 for implementing certainembodiments. The computing device 402 can include a processor 404 thatis communicatively coupled to a memory 406 and that executescomputer-executable program instructions and/or accesses informationstored in the memory 406. The processor 404 may comprise amicroprocessor, an application-specific integrated circuit (“ASIC”), astate machine, or other processing device.

The processor 404 can include any of a number of computer processingdevices, including one. Such a processor can include or may be incommunication with a computer-readable medium storing instructions that,when executed by the processor 404, cause the processor to perform thesteps described herein.

The computing device 402 can also include a bus 408. The bus 408 cancommunicatively couple one or more components of the computing system402. The computing device 402 can also include and/or be communicativelycoupled to a number of external or internal devices, such as input oroutput devices. For example, the computing device 402 is shown with aninput/output (“I/O”) interface 410, a display device 412, inputdevice(s) 414 and output device(s) 415.

Non-limiting examples of a display device 412 include a screenintegrated with the computing device 402, a monitor external and coupledwith the computing system, etc. Non-limiting examples of input devices414 include gaze detection devices (also referred to as eye trackingdevices), touch screens, touch pads, external mouse devices, microphonesand/or other devices mentioned herein, etc. A non-limiting example of anoutput device 415 is an audio speaker. In some embodiments, the displaydevice 412, the input device(s) 414 and the output device(s) 415 can beseparate devices. In other embodiments, the display device 412 and atleast some of the input device(s) 414 can be integrated in the samedevice. For example, a display device 412 may be a screen and an inputdevice 414 may be one or more components providing eye-tracking and/ortouch-screen functions for the display device, such as emitters foremitting light and/or cameras for imaging a user's eye(s) and/or a toucharea, etc. The screen, input device components and any output devicecomponents may be integrated within the same housing or in otherintegrated configurations.

The computing device 402 can modify, access, or otherwise use electroniccontent. The electronic content may be resident in any suitablenon-transitory computer-readable medium and execute on any suitableprocessor. In one embodiment, the electronic content can reside in thememory 406 at the computing system 402. In another embodiment, theelectronic content can be accessed by the computing system 402 from aremote content provider via a data network.

The memory 406 can include any suitable non-transitory computer-readablemedium. A computer-readable medium may include, but is not limited to,electronic, optical, magnetic, or other storage device capable ofproviding a processor with computer-readable instructions or otherprogram code. Other examples comprise, but are not limited to, a floppydisk, CD-ROM, DVD, magnetic disk, memory chip, ROM, RAM, an ASIC, aconfigured processor, optical storage, magnetic tape or other magneticstorage, or any other medium from which a computer processor can readinstructions. The instructions may comprise processor-specificinstructions generated by a compiler and/or an interpreter from codewritten in any suitable computer-programming language, including, forexample, C, C++, C#, Visual Basic, Java, Python, Perl, JavaScript, andActionScript.

A graphics module 416 stored in the memory 406 can configure theprocessor 404 to prepare electronic content for rendering in a graphicalinterface and/or render the electronic content in the graphicalinterface. In some embodiments, the graphics module 416 can be astand-alone application executed by the processor 404. In otherembodiments, the graphics module 416 can be a software module includedin or accessible by a separate application executed by the processor 404that is configured to modify, access, or otherwise use the electroniccontent.

It should be understood that the various methods described herein forinteracting with and controlling computer devices and computer programsmay be implemented by way of computer-readable instructions or otherprogram code, which may have various different and alternativefunctional arrangements, processing flows, method steps, etc. Anysuitable programming, scripting, or other type of language orcombinations of languages may be used to implement the teachingscontained herein in software to be used in programming or configuring acomputing device.

Unless specifically stated otherwise, it is appreciated that throughoutthis specification discussions utilizing terms such as “processing,”“computing,” “calculating,” “determining,” and “identifying” or the likerefer to actions or processes of a computing device. The use of “adaptedto” or “configured to” herein is meant as open and inclusive languagethat does not foreclose devices adapted to or configured to performadditional tasks or steps. Additionally, the use of “based on” is meantto be open and inclusive, in that a process, step, calculation, or otheraction “based on” one or more recited conditions or values may, inpractice, be based on additional conditions or values beyond thoserecited. Headings, lists, and numbering included herein are for ease ofexplanation only and are not meant to be limiting.

Numerous specific details are set forth herein to provide a thoroughunderstanding of the subject matter of the various embodiments. However,those skilled in the art will understand that such subject matter may bepracticed without some or all of these specific details. In otherinstances, methods, apparatuses, or systems that would be known by oneof ordinary skill have not been described in detail so as not to obscureclaimed subject matter.

While the present subject matter has been described in some detail withrespect to specific embodiments thereof, it will be appreciated thatthose skilled in the art, upon attaining an understanding of theforegoing, may readily produce alterations to, variations of, andequivalents to such embodiments. Accordingly, it should be understoodthat the present disclosure has been presented for purposes of examplerather than limitation, and does not preclude inclusion of suchmodifications, variations, and/or additions to the present subjectmatter as would be readily apparent to one of ordinary skill in the art.

What is claimed is:
 1. A system for controlling operation of at leastone subsystem of a vehicle on a roadway based on gaze directions of adriver of the vehicle over a period of time, wherein the systemcomprises: an eye tracking device for receiving gaze data indicative ofa series or sequence of gaze directions of the driver of the vehicletowards locations inside and outside the vehicle; and a processorconfigured to: determine, based on the gaze data, that the driver isgazing at locations inside and outside the vehicle; determine, based onthe gaze data, at least one of: a relative frequency at which the driveris gazing at locations inside relative to outside the vehicle; or arelative length of time during which the driver is gazing at locationsinside relative to outside the vehicle; and controlling operation of atleast one subsystem of the vehicle based at least in part on anintention of the driver regarding travel of the vehicle on the roadwayas determined from at least the relative frequency or the relativelength of time, and the series or sequence of gaze directions of thedriver of the vehicle towards locations inside and outside the vehicle.2. The system of claim 1, wherein the relative frequency at which thedriver is gazing at locations inside relative to outside the vehiclecomprises: a total amount of time during which the driver is gazing atlocations inside the vehicle relative to a total amount of time duringwhich the driver is gazing at locations outside the vehicle.
 3. Thesystem of claim 1, wherein controlling operation of at least onesubsystem of the vehicle based at least in part on the intention of thedriver regarding travel of the vehicle on the roadway as determined fromat least the relative frequency or the relative length of timecomprises: controlling operation of at least one subsystem of thevehicle based at least in part on the relative frequency exceeding apredetermined frequency.
 4. The system of claim 1, wherein controllingoperation of at least one subsystem of the vehicle based at least inpart on the intention of the driver regarding travel of the vehicle onthe roadway as determined from at least the relative frequency or therelative length of time comprises: controlling operation of at least onesubsystem of the vehicle based at least in part on the relative lengthof time exceeding a predetermined length of time.
 5. The system of claim1, wherein the at least one subsystem of the vehicle is selected from agroup consisting of: a safety subsystem; a braking subsystem; a steeringsubsystem; and an accelerator limiting system.
 6. A method forcontrolling operation of at least one subsystem of a vehicle on aroadway based on gaze directions of a driver of the vehicle over aperiod of time, wherein the method comprises: receiving gaze dataindicative of a series or sequence of gaze directions of the driver ofthe vehicle towards locations inside and outside the vehicle;determining, based on the gaze data, that the driver is gazing atlocations inside and outside the vehicle; determining, based on the gazedata, at least one of: a relative frequency at which the driver isgazing at locations inside relative to outside the vehicle; or arelative length of time during which the driver is gazing at locationsinside relative to outside the vehicle; and controlling operation of atleast one subsystem of the vehicle based at least in part on anintention of the drive regarding travel of the vehicle on the roadway asdetermined from at least the relative frequency or the relative lengthof time, and the series or sequence of gaze directions of the driver ofthe vehicle towards locations inside and outside the vehicle.
 7. Themethod of claim 6, wherein the relative frequency at which the driver isgazing at locations inside relative to outside the vehicle comprises: atotal amount of time during which the driver is gazing at locationsinside the vehicle relative to a total amount of time during which thedriver is gazing at locations outside the vehicle.
 8. The method ofclaim 6, wherein controlling operation of at least one subsystem of thevehicle based at least in part on the intention of the driver regardingtravel of the vehicle on the roadway as determined from at least therelative frequency or the relative length of time comprises: controllingoperation of at least one subsystem of the vehicle based at least inpart on the relative frequency exceeding a predetermined frequency. 9.The method of claim 6, wherein controlling operation of at least onesubsystem of the vehicle based at least in part on the intention of thedriver regarding travel of the vehicle on the roadway as determined fromat least the relative frequency or the relative length of timecomprises: controlling operation of at least one subsystem of thevehicle based at least in part on the relative length of time exceedinga predetermined length of time.
 10. The method of claim 6, wherein theat least one subsystem of the vehicle is selected from a groupconsisting of: a safety subsystem; a braking subsystem; a steeringsubsystem; and an accelerator limiting system.
 11. A non-transitorymachine readable medium having instructions stored thereon forcontrolling operation of at least one subsystem of a vehicle on aroadway based on gaze directions of a driver of the vehicle over aperiod of time, wherein the instructions are executable by one or moreprocessors for at least: receiving gaze data indicative of a series orsequence of gaze directions of the driver of the vehicle towardslocations inside and outside the vehicle; determining, based on the gazedata, that the driver is gazing at locations inside and outside thevehicle; determining, based on the gaze data, at least one of: arelative frequency at which the driver is gazing at locations insiderelative to outside the vehicle; or a relative length of time duringwhich the driver is gazing at locations inside relative to outside thevehicle; and controlling operation of at least one subsystem of thevehicle based at least in part on an intention of the drive regardingtravel of the vehicle on the roadway as determined from at least therelative frequency or the relative length of time, and the series orsequence of gaze directions of the driver of the vehicle towardslocations inside and outside the vehicle.
 12. The non-transitory machinereadable medium of claim 11, wherein the relative frequency at which thedriver is gazing at locations inside relative to outside the vehiclecomprises: a total amount of time during which the driver is gazing atlocations inside the vehicle relative to a total amount of time duringwhich the driver is gazing at locations outside the vehicle.
 13. Thenon-transitory machine readable medium of claim 11, wherein controllingoperation of at least one subsystem of the vehicle based at least inpart on the intention of the driver regarding travel of the vehicle onthe roadway as determined from at least the relative frequency or therelative length of time comprises: controlling operation of at least onesubsystem of the vehicle based at least in part on the relativefrequency exceeding a predetermined frequency.
 14. The non-transitorymachine readable medium of claim 11, wherein controlling operation of atleast one subsystem of the vehicle based at least in part on theintention of the driver regarding travel of the vehicle on the roadwayas determined from at least the relative frequency or the relativelength of time comprises: controlling operation of at least onesubsystem of the vehicle based at least in part on the relative lengthof time exceeding a predetermined length of time.